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1. Introduction 

In the simulation of quantum many-body systems such as ID spin chains one is 
faced with problems growing exponentially in the system size. Prom a linear alge- 
bra point of view, the physical system can be described by a Hermitian matrix H, 
the so-called Hamiltonian. The real eigenvalues of H correspond to the possible 
energy levels of the system, the related eigenvectors describe the corresponding 
states. The ground state is of important relevance because it is related to the state 
of minimal energy which naturally arises. To overcome the exponential growth of 
the state space with system size (sometimes referred to as 'curse of dimensionality') 
one uses sparse representation formats that scale only polynomially in the number 
of particles. In quantum physics concepts like Matrix Product States have been 



developed, see, e.g., 15J]. These concepts str ong ly relate to the Tensor- Train con- 
cept, which was introduced by Oseledets in 1 1411 as an alternative to the canonical 
decomposition [1, and the Tucker format [22] . 

In the MPS formalism vector components are represented by the trace of a product 
of matrices, which are often of moderate size. As will turn out, symmetries and 
further relations in these matrices result in special properties of the vectors to 
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be represented and, vice versa, that special symmetry properties of vectors can 
be expressed by certain relations of the MPS matrices. We will analyze different 
symmetries such as the bit-shift symmetry, the reverse symmetry, and the bit-flip 
symmetry, and we present normal forms of MPS for these symmetries, which will 
lead to a reduction of the degrees of freedom in the decomposition schemes. 

Organization of the Paper 

The paper is organized as follows: First, we list pertinent matrix symmetries 
translating into symmetry properties of their eigenvectors. Then we consider phys- 
ical model systems and summarize the related symmetries translating into sym- 
metries of the eigenvectors. After a fixing notation of Matrix Product States, we 
present normal forms of MPS and analyze how relations between the MPS matrices 
and symmetries of the represented vectors are interconnected. Finally, we show the 
amount of data reduction by exploiting symmetry- adapted normal forms. 

2. Matrix Symmetries 

In this section we recall some classes of structured matrices and list some important 
properties. A matrix A is called symmetric, if A = A T (i.e. ay = Oj j) and skew- 
symmetric, if A T = — A. A real- valued symmetric matrix has real eigenvalues 
and a set of orthogonal eigenvectors. If A is symmetric about the "northeast- 
to-southwest" diagonal, i.e. ay = a n -j+i,n-i+i, it is called persymmetric. Let 
J G M nxn , Jjj := Si >n+ i-j, be the exchange matrix. Then persymmetry can also be 
expressed by 

JAJ = A T . 

A matrix is symmetric persymmetric, if it is symmetric about both diagonals, i.e. 

JAJ = A T = A 

or component- wise 

= Q>j,i = On+1— i,n+l— j ■ 

Note that a matrix with the property JAJ = A is called centrosymmetric. There- 
fore, symmetric persymmetric or symmetric centrosymmetric are the same. 

The set of all symmetric persymmetric n x n matrices is closed under addition 
and under scalar multiplication. 

A matrix A is called symmetric skew-persymmetric if JAJ = — A T = —A, or 
component-wise 

— Q'jyi — Q"n+l—i,n+l—j • 

The set of these matrices is again closed under addition and scalar multiplication. 

Any symmetric n x n matrix A can be expressed as a sum of a persymmetric 
and a skew-persymmetric matrix: 

A = \ (A + JAJ) + \ (A - JAJ) . 

By J one may likewise characterize vector symmetries: a vector v £ W 1 is sym- 
metric if Jv = v and skew- symmetric if Jv = —v. 
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As all the matrices of subsequent interest are built by linear combinations of 
Kronecker products of smaller matrices the following lemma will be useful. 

Lemma 2.1: The Kronecker product of two symmetric persymmetric matrices 
B and C is again symmetric persymmetric. 

Proof : Let Jb and Jc denote the exchange matrices which correspond to the 
size of B and C respectively. Then the exchange matrix J of B <g> C is given by 
J = Jb <8> Jc- Therefore 

(Jb ® Jc)(B (8) C)(J B <8> Jc) = (J B BJ B ) ® (J C CJ C ) = (B T <g> C T ) = B <g> C . 

□ 

Remark 1 : Each power A k of a symmetric persymmetric A is again symmetric 
persymmetric. 

Remark 2 : For a symmetric skew-persymmetric A, A 2 is symmetric persym- 
metric, and also the Kronecker product of two symmetric skew-persymmetric ma- 
trices is symmetric persymmetric. 

Remark 3 : If matrix A is skew-symmetric, then A 2 is symmetric. Furthermore, 
the Kronecker product of two skew-symmetric matrices is symmetric. 

Due to |3J we can state various properties for symmetric persymmetric matrices 
and the related eigenvectors. As all the matrices of our interest have as size a power 
of 2, we focus on the statements related to even matrix sizes here. The following 
lemma points out the main results adapted from [3J. Both the proof and similar 
results for the odd case can be found in the original paper. 

Lemma 2.2 ([3]): Let A 6 IR nxn be any symmetric persymmetric matrix of even 
size n = 2m, the following properties hold. 



a) The matrix A can be written as 



B C T 
C JBJ 



with block matrices B and C of size m x m, where B is symmetric and C is 
persymmetric, i.e. C T = JCJ. 
b) The matrix A can be orthogonally transformed to a block diagonal matrix with 
blocks of half size m: 

1(1 J\/B C T \ (I I 
2 \I -J J \C JBJ ) \3 -J 

1/B + JC + C T J + B B + JC-C T J-B 
~ 2 I B - JC + C T J - B B - JC - C T J + B 



B + JC 
B - JC 



(1) 



c) The matrix A has m skew- symmetric orthonormal eigenvectors of the form 

1 f Ui 

V2 V ~ 3ui 
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where Ui are the orthonormal eigenvectors o/B — JC. 
A also has m symmetric orthonormal eigenvectors 



y/2 \JVi 



where the are the orthonormal eigenvectors o/B + JC. 

The discussed transformation (JTJ) to block diagonal matrices of smaller size is 
quite cheap and can be exploited to save computational costs, see, e.g., 0]. 

Remark 4 : In general, the transformation of symmetric persymmetric matrices 
to block diagonal form ([1]) cannot be continued recursively because the matrix 
B ± JC is symmetric but usually no longer persymmetric. 

Altogether, any symmetric persymmetric matrix has eigenvectors which are ei- 
ther symmetric or skew-symmetric, i.e. Jv = v or Jv = —v. However, one has to 
be careful with these statements in the case of degenerate eigenvalues. If the two 
blocks share an eigenvalue, A has as eigenvectors linear combinations of symmetric 
and skew-symmetric vectors, so the eigenvectors themselves are in general neither 
symmetric nor skew-symmetric. 

A matrix is called Toeplitz matrix, if it is of the form 



/ r n 
r-i r 



r, 



n-l \ 



n 



\r_ n+ i r-i r ) 



Toeplitz matrices obviously belong to the larger class of persymmetric matrices. 
Therefore, real symmetric Toeplitz matrices are symmetric persymmetric. An im- 
portant class of Toeplitz matrices are the circulant matrices taking the form 



/ r n r n _i\ 



V 



n 



n 



r n -\ r / 



Any circulant matrix C with entries r := (ro, r±, . . . , r n _i) T can be diagonalized 
by the Fourier matrix F n = (/_,-,*); fj,k = -±=e 27Tijk/n [91] via 



C = F- 1 diag(F n r)F n = F n diag(F n r)F n 



(2) 



Analogously, a skew- circulant matrix looks like 



/ r r\ 
-r„_i r Q 



-A 



V 



n 



-r n -i r I 
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In general, an u-circulant matrix with oj = e 1 ^ is defined by 



/ r n 
ur n -\ r 



r n -i\ 



These matrices can be transformed into a circulant matrix by the unitary diagonal 
matrix fi n;a , = diag(w J//n ).,- = o,...,n-i : 



O h P O 



/ r f x 

fn-l h 



-A 



V 



ri 



r n -i r ) 



(3) 



where f\~ := uj k l n r\ t . Multilevel circulant matrices are defined by the property 
that the eigenvector matrix is given by a tensor product of Fourier matrices 
F ni ® • • • ® F nk . Block- Toeplitz- Toeplitz- Block matrices, also called 2-level Toeplitz 
matrices, have a Toeplitz block structure where each block itself is Toeplitz. More 
general, a multilevel Toeplitz matrix has a hierarchy of blocks with Toeplitz struc- 
ture. 



2.1. Representations of Spin Hamiltonians 

For spin-^ particles such as electrons or protons, the spin angular momentum 
operator describing their internal degree of freedom (i.e. spin-up and spin-down) 
is usually expressed in terms of the Pauli matrices 

For further details, a reader wishing to approach quantum physics from linear and 
multilinear algebra may refer to [a]. Being traceless and Hermitian, {P x ,P y ,P z } 
forms a basis of the Lie algebra su(2), while by appending the 2x2 identity matrix 
I one obtains a basis of the Lie algebra u(2). This fact can be generalized in the 
following way: for any integer p a basis of the Lie algebra u(2 p ) is given by 

{Qi®Q 2 ®---®Q P ; Qi g {Px,P y ,P z ,I}} • 

To get a basis for su(2 p ) we have to consider only traceless matrices and therefore 
we have to exclude the identity, which results in the basis 

{Qi ® Q 2 ® • • • ® Q P ; Qi e {P x , P y , P z , I}} \ {I ® • ■ ■ ® 1} . 

Now, spin Hamiltonians are built by summing M terms, each of them represent- 
ing a physical (inter) action. These terms are themselves tensor products of Pauli 
matrices or identities 



M M 

H = V] a k (Qi k) ®Q^-® Q P k) ) = V h« , 



(4) 
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(k) 

where the coefficients are real and the matrices Q- can be P x , P y , P z or I. 



In each summand H^ k ^ most of the Qj are I: local terms have just one nontrivial 



j(k) 

tensor factor, while pair interactions have two of them. Higher m-body interactions 
(with m > 2) usually do not occur as physical primitives, but could be represented 
likewise by m Pauli matrices in the tensor product representing the m-order inter- 
action term. For defining spin Hamiltonians we will need tensor powers of the 2x2 
identity I: 

T®k . — T1O1...1Q1T 



For instance, in the Ising (ZZ) model (see e.g. [17|) for the ID chain with p spins 
and open boundary conditions, the spin Hamiltonian takes the form 

p-1 

H = ® (P z ) fc ® (P z ) fc+1 ® i®(p-*-i) 

k=1 (5) 



+ A 10(fe_1) ® ( p x)fc 8> I0(p " fc) 7 



fc=i 



where the index k denotes the position in the spin chain and the real number A 
describes the ratio of the strengths of the magnetic field and the pair interactions. 
Using fj,, v G {x, y, z}, one may define 



U u := ^ I® (fc_1) ® (P^)* ® I® (p " fc) , (6) 
fc=l 
p-1 

H w := 2 I®**" 1 ) ® (P^ 8) (P„) fc+1 8) I®(P-*-D . (7) 
fc=l 

The terms ([7]) correspond to the so-called open boundary case. In the periodic 
boundary case there are also connections between sites 1 and p, which reads 

= H w + (P^ ® I^- 2 ) ® (P„) p . (8) 

Note that in the literature often the identity matrices and the tensor products are 
ignored giving the equivalent notation 



H W := ^(P^kCP^k+l mod p ■ (9) 
k=l 

In analogy to the Ising model ((SJ) , it is customary to define various types of Heisen- 
berg models ([]], [l^]) in terms of (either vanishing or degenerate) real constants 
j x , j y and j z . Table Q] gives a list of possible ID models where, in addition, one 
may have either open or periodic boundary conditions. The operators with the ad- 
ditional term AH X are sometimes called generalized Heisenberg models. The XX, 
resp. XXX models are called isotropic. 
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Interaction Hamiltonian 



Ising-ZZ 




AHx 






Heisenberg-XX 


H xx 


f jxHyy - 


f AH X 




Heisenbcrg-XY 


izHxx - 




f AH X 




Heisenberg-XZ 


izHxx - 


f j z H zz 4 


AH X 




Heisenberg-XXX 


JxHxx 


t" jzHyy - 




+ AHx 


Heisenberg-XXZ 


jx H X x 


f JxHyy 


f i z H zz 


+ AH X 


Heisenberg-XYZ 


jiH xx - 




f j z H zz 


+ AH X 



For spin-1 models, the operators take the form 

1 /0 1 0\ /0 -i \ /l \ 

S x = -= 1 1 , S y = — [i -i , S z = . (10) 
v 2 \Q 1 0/ V2 \0 i 0/ \0 -1/ 

The AKLT model is defined as (flE]}) 

H = 2j SkSk+i + ^(S'fc^fc+i) 2 (11) 

where SkSk+i := (S x )jfc(S x )fc + i + (Sy) fc (Sy) fc+ i + (S z )fc(S z )fc + i. More generally, 
the bilinear biquadratic model has Hamiltonian 

H = ^ cos(0)S fe S fe+ i + sin(d?)(S fc S fc+1 ) 2 . (12) 

k 

These ID models can also be extended to 2 and higher dimensions. Then the 
neighbor relations cannot be represented linearly but they appear in each direction. 
For example, Eqn.[7]would read 

H W = ( P Ai)j( P M)fc > 

<j,k> 

where < j,k > denotes an interaction between particles j and k. 

Being a sum (j4]) of Kronecker products of structured 2x2 matrices, many Hamil- 
tonians have special properties, e.g., they can be multilevel-circulant (0, @j) or 
skew-circulant, diagonal or persymmetric (01), which can be exploited to derive 
properties of the respective eigenvalues and eigenvectors. 

2.2. Symmetry Properties of the Hamiltonians 

To begin, we list some properties of the Pauli matrices. 

Properties of the Pauli Matrices 

P x is symmetric persymmetric and circulant. Following Eqn.[2l P x can be diag- 
onalized via the Fourier matrix F2: 

™-IO -0(! o)(l -°0- p - <13) 
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The matrix P y /i is skew-symmetric persymmetric. P y is skew-circulant and by 
using Eqn. [3j it can be transformed into a circulant (and even real) matrix: 



x o -«y o y i y V 1 °/ 

which is due to (113f) orthogonally similar to P z . 

P z is diagonal and symmetric skew-persymmetric. The 2x2 identity matrix I is 
of course circulant, symmetric persymmetric and diagonal. 

Now we list symmetry properties of the matrices defined in Eqn. (jSJ) and (jSJ. 
As the matrices are built by Kronecker products of 2 x 2-matrices it will be useful 
to exploit the fact that the exchange matrix can also be expressed as Kronecker 
product of 2 x 2-matrices: 

J 2 p = J 2 <8> • • • J 2 = Px <8> • • • <8> Px • 

Due to Lemma 12.11 applied on this factorization the matrix H x — as a sum of 
Kronecker products of symmetric persymmetric matrices — is again symmetric 
persymmetric. Moreover, H x is multilevel-circulant as it can be diagonalized by 
the Kronecker product of the 2x2 Fourier matrix F2 : 



F 2 ) £ I®^" 1 ) (P x ) fe I®( p " fe ) (F a 



\k=l 



(15) 



= ^(FalFa)®^- 1 ) ® (F 2 P x F 2 ) fc ®(F 2 IF 2 )^- fc ) 
= (P.), I«P-*> § H, . 

k=l 

Therefore the eigenvalues of H x are all 2 P possible combinations 

±1±1±---±1 . 

Trivially, the matrix H y /i is skew-symmetric persymmetric and thus H y is Her- 
mitian. It can be transformed to H x via the Kronecker product of the diagonal 
transforms considered in Eqn. (|14p . 

Even for the generalized anisotropic case H an = H x n + Hy", where each sum- 
mand k in both sums may have an individual coefficient a k and b k , respectively, 
one can find an appropriate transform. To this end, consider 

p p 

= Ofc • (P X )fc I 0(P " fc) + ^ b k I^ k - l) ® (Py)fc ® I® (lJ - k) 

k=l k=l 

= J2 1 0(fc_1) ® (a fc (Px)fc + b k (P y ) k ) I^ p -V 
k=i 

= Y^I®^- 1 ) ® f a k - ib k \ ^(p-fc) 
f-^ V a fc + y 

k=l 
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(fc-i) 



k=l 

Each tensor factor 
C k : = 



r k e~ 1 ^ 

i4>k Q 



ne'^x 
r k e^ 



j®(p-fe) 



rue 



e 2i ^(r fc e-^) 



is w-circulant (a^ = e 2t< ^ k ). Following Q, C k can be transformed to a real matrix 
using the diagonal transform D k = fi2;^ k : 



D k C k D k ( r ° r Q fe ] r,P x . 



Therefore, the overall Hamiltonian H x n +H y n can be transformed to an anisotropic 
H x term: 



(Di ® • • • ® D p ) \ J2 ® C k €5 I^(f" fc )J (Dx 

= ^ I®^- 1 ) ® (D k C k D k ) ® 
fc=i 
p 

= rfel®^- 1 ) ® (P x ) fe ® I® (p - fc) = H* n . 



fc=i 



Analogously to H x (see Eqn. I15p . the resulting matrix H x n can be diagonalized by 
the Kronecker product F2 ® • • • ® F2. Therefore, the eigenvalues of H x n + H y n are 
given by all combinations 



Let us return to analyzing the properties of Hamiltonians. The matrix H z is 
obviously diagonal and skew-persymmetric. The matrix H xx is again symmetric 
persymmetric (see Lemma 12. ip . Similar to H x , H xx is again multilevel-circulant 
as it can be diagonalized by the Kronecker product of the 2x2 Fourier matrix F2. 
A computation similar to Eqn. (|15|) results in 



(F 2 



F 2 ) (H xx ) (F a ® ■ • • ® Pa) = H zz . 



The matrix H yy is real symmetric persymmetric as becomes obvious from 



Py®Py 



-i 

1 



-i 

1 



/ -l\ 

10 

10 

\-l / 



being real and symmetric persymmetric, which by Lemma [2.11 translates into a real 
symmetric persymmetric matrix H yy . 
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The matrix H zz is diagonal as it is constructed by a sum of Kronecker products 
of diagonal matrices. Moreover H zz is symmetric persymmetric via 



1 
-1 



/l 0\ 
0-100 

0-10 

\0 1/ 



according to Remark [2j 

Obviously, the spin-1 operators (|10[) have similar symmetry properties as their 
2x2 counterparts: the matrix S x is real symmetric persymmetric and has Toeplitz 
format, S y /i is a real and skew-symmetric persymmetric Toeplitz matrix, and S z 
is symmetric skew-persymmetric and diagonal. The Kronecker product S y (g) S y 
reads 



Sy®S y = -- 1 
Z \0 1 



\ /0 -1 \ 
-1 ® 1 -1 
/ \0 1 / 



a real symmetric persymmetric matrix (compare Remark [3]). Following Remark [2l 
the Kronecker product S z (g) S z is symmetric persymmetric. Therefore, according to 
Remark[T]and Lemma [2. 11 Both the AKLT model (jlip and the generalized bilinear 
biquadratic model (|12p result in real symmetric persymmtric matrices. 

Altogether all previously introduced physical models such as the ID models listed 
in Table Q] define real and symmetric persymmetric matrices. Due to Lemma 12.21 
the related eigenvectors such as the ground state (which corresponds to the lowest- 
lying eigenvalue) are either symmetric or skew-symmetric. 



3. Application to Matrix Product States 



For efficiently simulating quantum many-body systems, one has to find a sparse 
(approximate) representation, because otherwise the state space would grow ex- 
ponentially with the number of particles. Here 'efficiently' means using resources 
(and hence representations) growing only polynomially in the system size p. In the 
quantum information (QI) society, Matrix Product States are in use to treat ID 
problems. 



3.1. Matrix Product States: Formalism and Normal Forms 

This paragraph summarizes some well-known basics about MPS. We provide both 
the MPS formalism and normal forms for MPS, which are well-known in the QI 
society, from a (multi-)linear algebra point of view. Afterwards we present own 
findings to construct normal forms and discuss the benefit of such forms. 

3.1.1. Formalism 

For ID spin systems, consider Matrix Product States, where every physical site 
j is associated with a pair of matrices Aj , £ <C D i xD i+i } representing one of 
the two possibilities spin-up or spin-down. 

Let *2j - - ■ )%>) denote the binary representation of the integer index i. Then 



Exploiting Matrix Symmetries and Physical Symmetries in Matrix Product States 11 

the ith vector component takes the form 

(ii) a (fa) Afe)' 



^ lp = tr A^.A™-A^ . (16) 



Hence, the overall vector x can be expressed as 

2'' 

x = ^ ] ^i e i = ^ ^ 3^ 6i x ® ' ' " ® 6j p 

i=l i\,i2,—,ip 

= tr (a? i) • Af } • • • Ag p) ) e 4l <g> • • • ® e ip 

/ y I / j ■ n -\\m\,m% ^2;m 2 ,r?i3 n p:mp,mi I c «i v 
ii,...,i p ^mi,...,m p ' 

= X] ( X] ^imLm, 6 *! J ® ® ( ^ 4;m.,mi e V 
m 1 ,...,m p ^ ti ' ^ j„ 

= ^ ^ a l;mi,mj ® a 2;m 2 ,m 3 8) • • • ® flp;m p ,mi 

mi,m2,...,m p 

with vectors flj ;m j,m j+1 modp of length 2. These vectors are pairs of entries at 

position mj,mj + i mo dp from the matrix pair Aj lj \ ij = 0, 1. 

We distinguish between open boundary conditions, where D\ = D p+ \ = 1 and 
periodic boundary conditions, where the first and last particles are also connected: 
D% = D p+ i > 1. The first case corresponds to the Tensor Train format ([3), the 

12]). Considerations on MPS from a mathemat- 

3 



latter to the Tensor Chain format ( 
ical point of view can be found in 



3.1.2. Normal Forms 

The MPS ansatz does not lead to unique representations, because we can always 
introduce factors of the form MjMr 1 between A^ and A^t 1 ^. In order to reduce 

J J J"T"- L 

this ambiguity in the open boundary case one can use the SVD to replace the 
matrix pair (Aj , Aj 1 ^) by parts of unitary matrices (see, e.g. (HI). To this end, 
one may start from the left (right), carry out an SVD, replace the current pair of 
MPS matrices by parts of unitary matrices, shift the remaining SVD part to the 
right (left) neighbor, and proceed recursively with the neighboring site. Starting 
from the left one obtains a left-normalized MPS representation fulfilling the gauge 
condition 

(Af) H Af + (A«) H A«=I. (17) 

Analogously, if we start the procedure from the right, we end up with a right- 
normalized MPS representation fulfilling 

Af (Af ) H + A J (1) (A J (1) ) H = I. (18) 

In the periodic boundary case these gauge conditions can only be achieved for all 
up to one site. 

Still some ambiguity remains because we can insert WjWj H with any unitary 
Wj in the MPS representation (|16p between the two terms at position j and j + 1 
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without any effect to the gauge conditions (fTTj) or (T18|) . To overcome this ambiguity 
a stronger normalization can be derived (see, e.g. [3]). It is based on different 
matricizations of the vector to be represented and can be written in the form 

Xil ... ip = lf } (Axlf } ) (A 2 lf )) • • • (Ap-ilf } ) = A^ A™ ■ ■ ■ AjH (19) 

with diagonal matrices Aj containing the singular values of special matricizations 
of the vector x. The following lemma states the existence of such an MPS represen- 
tation. 



Lemma 3.1 ( [241] ): Any vector x 6 C 2 " of norm 1 can be represented by an MPS 
representation fulfilling the left conditions 

(Af) H Af + (A«) H A«=I (20a) 



j 

or the right conditions 



Aj 0) A?(Aj 0) ) H + A«A|(Af )) H = A|_j (20b) 



A (0)(Af) H + A( 1) (A j ( 1) ) H = I (21a) 
(Af ) H A^ lA f + (Af ^A^Af) = A? , (21b) 

where the -Dj+i x -Dj+i diagonal matrices Aj contain the non-zero singular values of 
the matricization of x relative to index partitioning ...,ij), (ij+i, ■■■,ip), diagonal 
entries ordered in descending order. 

The proof of this lemma is constructive and provides MPS factors Aj lj ^ again 
as parts of unitary matrices, but satisfying two normalization conditions. These 
conditions are well-known in the QI society, see, e.g., [U Hit]. The following proof 
is adapted from [3], but we reformulate it in mathematical (matrix) notation. 



Proof : Let us prove representation (|20p for a given vector x by orthogonalization 
from the left. We start with considering the SVD of the first matricization relative 
to ix, 

X, (i2 ip) = U lAl W 2 = ( A l^ W A = ( T l^ W2 ) (22) 

with the notation Ai = Ui = T± and Ai containing all positive singular values. 
Therefore, the columns of Ui are pairwise orthonormal satisfying 

I = A? Ax = (Af ) H Ai 0) + (A«) H AW . 
Now, the second matricization gives the SVD 



X (il , i2 ), (i3 ,..., ip) = U 2 A 2 W 3 = TT f 1} A 2 W 3 . (23) 




Note that because both matricizations (j22j) and (123|) represent the same vector X, 
each column of U 2 can be represented as TiAi • T 2 f° r some T 2 . This follows 
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by 

U 2 0) A 2 W 3 = riAiW 2 . 

Picking a full-rank submatrix C of A2W3 and applying the inverse from the right 
yields 

U 2 0) = TxAxWa . 

The same holds for with some r 2 , With these matrices r 2 °^ and r 2 we can 
write 



U 5 



with 



A 2 °)\ ._ ( Al r< >\ _ /rH ri A ir w\ _ (r^r 
a? J - UrfV " lrH ri A ir « J " lr=u« 



(24) 



In view of the SVD representation (j23|) of X^^v^ $ ) one finds 

i = u»u 2 = (A 2 )) H r? ri A 2 ) + ( A W) H r?r lA w 

= (A 2 °)) H A 2 °) + (A 2 1 )) H A 2 1 ), 

which corresponds to the first normalization condition (|20ap . Now we can rewrite 
the second matricization (1231) as 



X (Ii,la),(i».....tp) 



u 
u 



H a,w, - ( , riA 1 r<°»A 2 w 3 \ 
(i,J a 2 w 3 - ^ riAir a, A2W J 



Comparing this form of the vector X with the first matricization (|22p gives 

w 2 = (r 2 0) A 2 w 3 r^A.Ws) 

and therefore 

™-(rfA 2 W3 r«A 2 w 3 ) 
= r<°>A|(r<°)) H + r< 1 )Al(r< 1 )) H . 

Multiplying from both sides with Ai is just the second condition (|20bj) : 
K\ = A^A^lf^ A x + A^AKT^YA, 

= a 2 °)aI(a 2 °)) h + a 2 1 )a|(a 2 1 )) h . 



14 



Huckle, Waldherr, Schulte- Herbriiggen 



In the same way we can use the two matricizations X^^) ^ \ \ and 
X( il! i 2i i 3 ) i (i 4i ... i i p ) to derive A 3 , based on A 2 , T 2 , U 3 , W 3 , W 4 and A 3 , satisfying 
the normalization conditions (|20p . Then A4,..., A p follow similarly. 

Starting from the right and using a similar procedure gives the representation 
satisfying the normalization conditions (|21[) . □ 

Remark 1 : 

(1) The resulting MPS representation is unique up to unitary diagonal matrices 
as long as the singular values in each diagonal matrix Aj are in descending 



order and have no degeneracy (are all different), compare 151 ] . 

(2) One may consider the constructive proof as a possible introduction of MPS 
([13, HI)- Then the conditions (J2DJ) or ((21]) appear naturally 

(3) The proof shows that, in general, an exact representation comes at the cost 
of exponentially growing matrix dimensions Dj. For keeping the matrix 
dimensions limited one would have to introduce SVD-based truncations. 



(4) The Vidal normalization 24( uses r| lj ^ and Aj in (I19p instead of a[ 1j ^ 



(5) Starting from a given MPS A-representation (|16p it is possible ([2l|) to 
build an equivalent AT-representation (|19p without considering the matri- 
cizations explicitly. The construction starts from a right-normalized MPS 
representation (|18p and then iteratively computes SVDs of modified de- 
compositions related to two neighboring sites. The conversion from the 
AT-form to the A-form is simpler: From (|24p it becomes obvious to set 

Aj lj ^ = Aj_iFj lj ^ (Ao := 1) in the left-normalized case (|20p . Analogously, 

in the right normalized case (|2ip we would define Aj 1j ^ = rj^Aj, where 
A p := 1. 

(6) The AT-representation (fl~9l) corresponds to the Schmidt decomposition, 
which is well-known in QI. The Schmidt coefficients are just the diagonal 
entries of Aj (\2l\). 

(7) The diagonal matrices Aj contain the singular values of special matriciza- 
tions of the vector to be represented. Hence, local matrices Aj reflect global 
information on the tensor via the normalization conditions and the diagonal 
matrices Aj. That is one of the reasons why MPS has proper approximation 
properties (flU). 

3.1.3. Further Normal Forms 

Finally we propose own findings of concepts to introduce possible normal forms 
for MPS. 

As an alternative to construct the gauge conditions (fTTl) or (fTHl) we propose 
(compare [ill]) to consider two neighboring pairs (compare two-site DMRG [Hf) 




A (o) A (o) A (o) A (i) 
A«A°l A«A« 



AjUffx AjUftJ (25) 



uffi) • ( 26 ) 



In this way all matrix pairs (Aj , Aj 1 ^) (up to one in the periodic boundary case) 
can be assumed as part of a unitary matrix giving the normalization conditions 




SVD 



j+1 

.0, , TT (D 
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(|17p in the left-normalized case (|25p or (|18p in the right-normalized case (|26|) . 

To circumvent the fact that the gauge conditions (fT?]) or (fT8|) still introduce 
some ambiguity we propose the following way to derive a stronger normalization. 
Suppose that the MPS matrices are already in the left-normalized form 

(Af ) H Af + (a«) h aW = j ,•„, i p . 

The proposed normal form is now based on the SVD of the upper matrices 
Aj°^ = UjSljVj with unitary Uj,Vj (Vo := 1) and diagonal non- negative Ej, 

diagonal entries ordered relative to absolute value. Then, every pair (Aj , Aj 1 ^) 
is replaced by 

(Af , Af )) = (Vj^UjEj , Vj _ lA f V?) (27) 

leading to the stronger normalization conditions 

(Af) H Af + (Af )) H A{ 1J = SfSj + Af Aj = I (28) 

with diagonal matrices Sj and Aj. From (|28p we can read that this normal form 
provides MPS matrices with orthogonal columns. For the upper matrices Aj ^ this 

fact is caused by construction, but it then automatically follows also for the Aj 
matrices. Especially for the left-most site j = 1, the normalization condition (j28|) 

leads to A±' = (1,0) and A-j 1 ^ = (0, 1). We may of course also start the proposed 
normalization procedure with a right-normalized form, resulting in a representation 
where the MPS matrices have orthogonal rows. 

3.1.4- Comparison of the Normal Forms 

All of the presented normal forms introduce some kind of uniqueness to the 
MPS formalism, which initially is not unique. Therefore, these normal forms help 
to prevent redundancy in the representations. As a consequence we may expect 
less memory demands as well as better properties of numerical algorithms such 
as faster convergence, better approximation, and improved stability. The normal 
form (|20p is advantageous as it connects local and global information. However, 
the construction involves the inverse of the diagonal SVD matrices which may 
cause numerical problems. Our normal form (128|) can be built without division by 
singular values, but the information is more local. 



3.2. Symmetries in MPS 

The results from Section [2] show that the matrices which describe the physical 
model systems have special symmetry properties which result in symmetry prop- 
erties of the related eigenvectors: the eigenvector of a symmetric persymmetric 
Hamiltonian has to be symmetric or skew-symmetric, i.e. Jv = ±v. One might 
also think about other symmetries which could be of the form 




or more general Pi> = ±v 



with a general permutation P. Furthermore, we can have vectors satisfying k dif- 
ferent independent symmetry properties, e.g. PjV = ±v for permutations Pj, 
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j = 1, ...,k. 

At this point the question arises how these symmetry properties can be expressed 
in terms of MPS, and, vice versa, how special properties such as certain relations 
between the MPS matrices emerge in the represented vector. 

Symmetries in MPS already appear in different QI publications: theoretical con- 
siderations on symmetries in MPS can be found in [la . [2o| . symmetries in ti MPS 
representations are exploited in [18], and the application of involutions has been 
analyzed in [19]. The main goal of this paragraph is to present an overview of 
different types of symmetries in a unifying way and to give results concerning the 
uniqueness of such symmetry-adapted representation approaches by proposing pos- 
sible normal forms. Our results are intended for a theoretical purpose (similar to 



la . I2Q] ) but are also interesting for numerical applications (similar to [18j, LL9[] ) . 

After some technical considerations we discuss which properties of the matrices 
Aj lj ^ that define an MPS vector x are related to certain symmetry properties of 
x. Deriving normal forms for different symmetries of MPS vectors will also be of 
interest. 

3.2.1. Technical Remarks 

In view of the trace taken in the MPS formalism (I16p , recall the following trivial 
yet useful properties 

tr (AB) = tr(BA) , (29) 
tr (AB) = tr (AB) T = tr (B T A T ) for tr (AB) G M , (30) 



tr (AB) = tr (AB) H = tr (B H A H ) for tr (AB) G C (31) 

in order to arrive at relations of the form 

tr (Af ) • A^ • • • Ai«) # tr (a&*> • • • Ag*> A™ " " " ^) 

GSK r /'A(ir)H A (i r -i)H A (i 1 )H.(i p )H A (i r+ i)H\ 
— Li 1 .fv r ±\. r _j • • • ±\.p • • • ±\. rJr -^ 1 . 



For the proof of the main theorems we will need the following three lemmata. 
Lemma 3.2: Let A,B G K nxm , where K G {R, C}. If the equality 

tr (AX) = tr (BX) 

holds for all matrices X G K mxn , then A = B. 

Proof : The relation tr (AX) = tr (BX) is equivalent to 

tr ((A - B)X) = 

for all matrices X. For the special choice X = (A — B) H we obtain 

tr ((A - B)(A - B) H ) = ||A - B||| = , 

which shows A = B. □ 
Lemma 3.3: Assume that for U G lK nxn and V G K mxm it holds 

X = VXU (32) 
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for all matrices X £ K mxn . Then U = cl n , V = I m /c wii/i some c / 0. 

Proof : Obviously, V and U have to be non-zero and, moreover, they are regular. 
Otherwise, if e.g. Va = for a / 0, we can define X = ab H with some 6^0 
leading to a contradiction. Choosing X = ab H as rank-one matrix for any vectors a 
and b, it follows (V _1 a)5 H = a(o H U). Therefore, V _1 a and a have to be collinear 
(V _1 a = Aa with some A 6 K), and 6 H U and fo H also have to be collinear (b H U = 
/_i& H ). Hence, U and V -1 (and therefore also V) have all vectors of appropriate size 
as eigenvectors, and therefore they are nonzero multiples of the identity matrix, 
U = C]I n and V = C2l m - Condition ([32]) finally shows c = c\ = l/c2- □ 

Similarly, we can derive the following result: 



for all matrices X S lK mxn . Then U = cl n , V = cl m with a scalar c E IK. 

Proof : First we prove that, if at least one of the two matrices U or V is singular, 
both of them have to be zero. Obviously, if one of the two matrices is zero, the 
other one has to be zero as well. If we now suppose V to be singular and U to 
be nonzero, we can find vectors and b, such that Va = and b H U 7^ H . 

The choice X = afo H ^ leads to a contradiction. The same argument counts if 
we change the roles of U and V. 

Otherwise, if both matrices are regular, the statement of the lemma is a direct 
consequence from Lemma 13.31 □ 

3.2.2. Bit-Shift Symmetry and Translational Invariance 
To begin, consider the case where all matrix pairs are equal, i.e. 



for all j = 1, . . . ,p. Then the MPS is site-independent and describes a translational 
invariant (TI) state on a spin system with periodic boundary conditions The 
following theorem states that the result of such a relation is a bit-shift symmetry, 
i.e. 



Lemma 3.4: Assume that for U € K? 



and V € W 



it holds 



XU = VX 




(33) 



ii,i 2 ,---,i P ^ii,i 3 ,...,i v ,i\ '"' x i p ,ii,i2,— ,i p -i ■ 



Theorem 3.5 ([15]): // the MPS matrices are site-independent (and thus fulfill 
Eqn. \33\) the represented vector has the bit-shift symmetry and in turn every vector 
with the bit- shift symmetry can be represented by a site-independent MPS. 
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Proof : To see that a Tl MPS (|33p leads to a bit-shift symmetry, consider 



tr ( A^A^ ••• A^AM 



121 



tr ( A^A^ ■ ■ ■ A^ ip ) A^'^A^ 2 ) 



l 2 ,l3,...,lp,ll 



2^3,...,i p ,ii,i 2 



tr ( A^A^ ••• A^- 1 ) 



x 



Let us now suppose that the vector x has the bit-shift symmetry and let 



trfB^B^-.-B^ 



be any MPS representation for a;. Then the construction 



/ b£ j) \ 



A(^) = — 



B 



ft) •. 



B<W 



(34) 



leads to a site-independent representation of a?. 



□ 



Remark 2 : The construction (|34p introduces an augmentation of the matrix size 
by the factor p. 

The bit-shift symmetry can also be generalized to block-shift symmetry. Assume 
that a block of r MPS matrix pairs is repeated, i.e. 



} A£ 2) • • • A^ ] ) (A^ +l) Al ir+2) • • • A (i2r) 



(a^a^.-.a^J (a™a 2 

to obtain symmetries of the form 



(ip-r+i) a (ip-r+a) a( I p) 

L-i rii) • • • V- 



Normal Form for the Bit-Shift Symmetry 

In the above periodic TI ansatz (|33p we can replace each A by MAM -1 with 
a nonsingular M resulting in the same vector x. Using the Schur normal form 
A(°) = Q H PJ°)Q or the Jordan canonical form A^ ) = S _1 J^S we propose to 
normalize the MPS form by replacing the matrix pair (A^ ), A^ 1 )) by 

(AW,A( 1 )) = (R(°),QA( 1 )Q H ) or (AWAW) = SA^S" 1 ) 

resulting in a more compact representation of x with less free parameters. For 
Hermitian A*- ) and A^ 1 ) the eigenvalue decomposition of A*- ) = Q h D(°)Q with 
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diagonal matrix D^ ** can be used in the same way leading to the normal form 

(a(°),a( 1 )) = (d(°),qaWq h ) 

with A(°) as real diagonal matrix and A^ 1 ) as Hermitian matrix. 
3.2.3. Reverse Symmetry 
In this subsection we consider the reverse symmetry 

= %i p ,...,ii ■ (35) 

The following theorem shows a direct connection between the reverse symmetry 
and an MPS representation with the special symmetry relations 

{A^f = S-ijA^.jSp+x-j for all j = 1, . . . ,p (36) 

with regular matrices Sj of appropriate size, which additionally fulfill the consis- 
tency conditions 

S = S p and Sf = S p j for j = 1, . . . ,p . (37) 

Theorem 3.6 : If the MPS matrices fulfill the symmetry relations I136\) . the vec- 
tor to be represented has the reverse symmetry property 135\) . Vice versa, for any 
vector x fulfilling the reverse symmetry, we may state an MPS representation for x 
fulfilling the relations i36\). 

Proof : For the vector x to be represented, the relations ()36f) lead to 

T . . _ trfxQi) aQ*) . . . A (ip)N l 
•^lx,...,i p — L H 1 2 A P J 

= tr(A^A^...A p ^) H 

= tr (A^> H Ajr^ H • • • Af> H A? l > H ) 

= tr ((Sp^A^Sx) (S^^ApSj • • • (S-i^Sp)) 

= tr (a? p) A^- l} • • • A p il} ) 

x i p ,...,ii > 

a reverse symmetric vector. 

So far we have seen that the relations ([36]) lead to the representation of a vector 
having the reverse symmetry. Contrariwise, it is possible to indicate an MPS repre- 
sentation fulfilling the relations (|36[) for any reverse symmetric vector. To see this 
we consider any MPS for x: 

x il>w .., ip =tr(B^B^...B p W) 

with matrices Bj lj ^ of size Dj x Dj+i. Such an MPS representation always exists, 
compare Lemma 13. 11 
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Let us start with the case where this MPS representation is in PBC form. The 
reverse symmetry Xj lj j 2v .. j j p = ^ » ^...^ leads to 



2 { x ii,t2,---,ip x ip,i P -i, 

\ (tt(B^B^ ■ ■ ■ B p ip) ) + tr(B? p) Bj p - l) 



B 



\ (tr^^B^ • • • B p ip) ) + ^(B^^BjJl^ • • • B? p)H 

o \ 



itr 



tr 



' ■R( i i)r»( i a) p»(ip) 



B 



(ii) 






r.(ii)H R (i 2 )H 
D P D p 1 




o \ 


B^ H ) 





B 



(ip)H 



B 



(i P ) 
P 

B 



(ip)H 



We may now define 



A (ij) ._ J_ 



B 



(ij) 



B 



(ij)H 
P+l-j/ 



and obtain 



i 

^2 



B j 



(ij)H 



B 



(ij) 

P+l-j/ 



WO I 

^2 I I 



B 



(ij) 

P+l-j 
B^ 



I 



(38) 





(ij)H 



1 A ft) « 

1 P+i-i I o 



with I being identities of appropriate size. Hence, the choice 



(39) 



lD j+1 
K+x-j 



for all j = l, 



,P 



gives Aj 



(ij)H 



- 1 A*? 



p j 



p+i-jSp+i-j, the desired matrix relations ([36 



(40) 



In the OBC case we can proceed in a similar way, but at both ends j ' = 1 and 
j = p something special happens: as we want to preserve the OBC character of 
the MPS representation, the matrices and A p lp ^ have to be vectors as well. 

Therefore we define 



*(ii)_J_/ R (ii) R (ii)H\ j A (i P ) _ J_ [ B P 

A l _ V2 V I p / P ~ ^2 I B («p 



(i P ) N 
)H 



The choice S p = 1 leads to the desired relation (A^^) H = S^l-, An^Sr 



'p-i^p 



□ 



Remark 3 : 



(1) The proof shows that the reverse symmetry can occur in the periodic bound- 

ioundar» 



ary case, but also for the open boundary case where Aj 11 ^ and A p lp ' ) spe- 



cialize to vectors. Then, So 



Sq are simply (even real) scalars. 
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(2) In the proof, the matrices Sj can be chosen to be unitary, compare (|40p . 
Thus, they can be diagonalized by a unitary transform Vj giving 

Sj = VjAjVj 1 with diagonal and unitary Aj . 

Because of S~ = = . = S; the relations (1551) read 
p j p — j J * * 

(Aj W ) H = SjAgJ^Sp+n 

= (VjAjVf )Ag 1 _ j (V p+1 _ j A p+1 _ j Vj +1 _.) . 

The last equation can be rewritten to 

Vf (Af ))% H = AjVf A«J 1 . J V P+1 _ J A^ 1 _ J . 
Defining Aj 1 -" := Vp +1 _jAj(ij)Vj, the relations ([36]) take the form 

(Af )) H = AjAg^Ap+n (41) 

with unitary diagonal matrices Aj fulfilling A^ = A p _j. If the matrices Sj 
are unitary and also Hermitian, the diagonal matrices Aj have values ±1 
on the main diagonal. 

(3) In the PBC case with MPS matrices Bj 1 ^ of equal size D x D, the Sj 
matrices (I40p can be chosen to be site-independent, Hermitian, and unitary. 
In this case the relations (f4"Tj) are fulfilled by Aj = diag(Io, — Id)- 

Normal Form for the Reverse Symmetry 

In the following theorem we propose a normal form for MPS representations of 
reverse symmetric vectors. 

Theorem 3.7: Let x € C 2 " be a vector with the reverse symmetry. If p = 2m is 
even, x can be represented by an MPS of the form 

x iui2 ,..,i p = tr ((U? l > • • • U^)£(U£H H • • • U<p)A) (42) 

and if p = 2m + 1 is odd, the representation reads 

x lul2 ,..., lp = tr ((U^ • • • ugr ) )U&i l) E(uSr ,)H • • • U< WH ) A) (43) 

with unitary matrices U- lj ^ and real and diagonal matrices S and A. 

Proof : We start with an MPS of the form (|36|) to represent the given vector x, 
compare Theorem 13.61 
In the case of p = 2m being even, we obtain 

x- ■ -tr('A (il) A (i2) ---A (im) A (im+l) ---A (ip) 'l 

# tr (A?i>A^ • • • A&"> (SHA^^S-H,) • • • (S«A^ H S p »)) 
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(ii) A Pa) A ('™)\ cH I A (im+i)H * (ip)H\ q— H 



= tr ((A^A^ • • • A^>)S*(A^> n • • • A^)S p H ) . (44) 

Following ((371) we obtain Sp 1 = S p and thus we may factorize S p H = WAW H . 
Using Eqn. (JUJ) reads 



tr [(W H A^)A^ • • • At ] S* At +l)H ■ • • A^- l)H (W H Af p) ) H A 

We use the SVD of W H Ai, 

/ W H A (0)\ / n (0)\ 
(.W^D J = [l$ ) AlVl ' 

to replace W H Ai at both ends. We then obtain 

tr (u< u) (A^A^) • • • A^S* (a£t i)H " " " {A^V* A^") a) . 
We proceed with the SVD for AiViA£ 2) , i.e. AiViA^ = U^ 2) A 2 V 2 , to obtain 
tr (u^U^AaVaA^) • • • A^ } S« A^ +l)H • • • (A<j i3)H V«A 2 )U 2 ip - l)H U^ )H A 
Proceeding in an iterative way finally gives 

tr ((U^TjjM • • • Ufr°) (A m V m Sg 1 Vg 1 A m K U^ +l)H ■ ■ ■ U^ )H V^ a) . 

= :C 

For j = m, Eqn. [37] yields = S m and thus C is also Hermitian leading to 



A m V m S* V* A m = C = C H = XSX 1 



with unitary X and real diagonal S. Altogether we obtain the MPS representation 
tr (U^uf) • • • (u£ m) X)£(X H u£r +l)H ) • • • U 2 ip - l)H uf p) V 



Replacing Us by the unitary matrix u£|x gives the desired normal form (|42jl . 

For the odd case p = 2m + 1, we may proceed in a similar way and replace all 
factors up to the interior one related to j = m + 1 by unitary matrices to obtain 

tr ((u^uf) • • • u£r } ) (A m v m Aj;y 1 l) sg 1 v^A m K u^ +2)H • • • u^ )H ) a) . 

= :C< i m +i> 

For site j = m + 1 the supposed matrix relations lead to 

ifWiU^.c / A (i m+1 )\ H IP q (q-lA(Wi)q \ 133 i(im+i)qH 

and thus the matrices c( Im+1 ) are both Hermitian. Using the SVD gives 

C (i m+1 ) = U0-+OEX = X H £u£"; + i )H . (45) 
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Hence, for the overall representation we obtain 



tr ((Ui il} • • • U& ) (U^EX) (Ut +2)U ■ ■ ■ U<p) A) 

=tr (uf l} • • • (u[ir } x H ) (xufe l) )s(u£ tt+a) x H ) H • • • (uJ p) ) h a) . 

Replacing uJJ by uJj|x H and Xj|^ +1 by XU^lj leads to the normal form (j4"3j) 
for the odd case. □ 

Remark 4 : In the odd case we may also use the right-side SVD factorization 
— X H SU|^_ + 1 1 '' H m Eqn. |J5] leading to the normal form 

tr ((Uf l} • • • U^^EU^^CU^ 11 • • • uJ p)H ) A) . 

This ambiguity is reasonable as the interior factor in the odd case only has itself 
as counter part: Ai <H> A p , A 2 A p _i, . . . , A m o A m+2 , A m+ i O A m+ i. 

Reverse Symmetry in TI Representations 

Let us finally consider the reverse symmetry in TI representations. This ad- 
ditional property allows us to use site-independent matrices Sj = S, which are 
Hermitian, compare (I37p . Then the relations (I36p take the form 

(A«) H = S^A^S {A^S) R = A«S . 

Thus, we can represent the vector with Hermitian matrices A^ 1 ) := A^S. In the QI 
society one can find considerations on TI systems using real symmetric matrices, 
compare [l8( ]. 

3.2.4- Bit-Flip Symmetry 

Here we focus on the representation of symmetric and skew-symmetric vectors ap- 
pearing, e.g., as eigenvectors of symmetric persymmetric matrices (see Lemma [2.2p . 
We will use the bit-flip operator i := 1 — % for i G {0, 1}. First we show that the 
symmetry condition Jx = x corresponds to the bit-flip symmetry 

x ii,i 2 ,—,i P = x i 1 ,i 2 ,...,i p • 

To see this we consider 

JX = (J 2 ® • • • ® J 2 ) I ^ X ii,i2,-,i P ( e ii ® • • • ® e i P ) ) 
\ii,...,i p / 

= Yl X ii,i2,-,i P (( J 2 e ii)®---®( J 2 e O) 

%i,...,i p 

= 2 ^ vk®'" 8e i P ) 

= ^.....^(cii® •■•®e 4 „) . 
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Hence we obtain 



Jx — X aJ»i,ia,—i*p ~~ X ii,i 2 ,---,i P ^ OT aU il) • • • , *p — 0, 1 . 

Analogously, for a skew-symmetric vector a; one gets x^,^,...,^ = — zcj ^ j . 
In order to express these relations in the MPS formalism consider 

A, (1) = Uj Aj 0) U j+1 mod p for j = 1, . . . ,p (46) 



with Uj being involutions, i.e. Uj = I ([19]). Then Eqn. (05) can also be expressed 
vice versa to give 

A_j ij) = UjAf } U j+1 mod p . (47) 

The following lemma shows the correspondence between these relations and the 
bit-flip symmetry. 

Theorem 3.8: If the matrix pairs (A^jAj 1 ^) are connected via involutions as 
in the represented vector has the bit-flip symmetry and is hence symmetric. 
Contrariwise any symmetric vector can be represented by an MPS fulfilling condi- 
tion [46] ). 



Proof : The matrix relations (|46p translate into the symmetry of the represented 
vector 

r ■ ■ - tr ( A (il) • A (ia) • • • A (ip) 



S3 



tr ^UiA^UaJ • (U a A^U 8 ) • • • (UpA^Ui 
tr(A^Ap...A^) 



x i 1 ,i 2 ,---,i P - 

Let us now consider the construction of an MPS representation (|46|) for a sym- 
metric vector x fulfilling the bit-flip symmetry Xj li j 2i ... i j p = Xf lt f 2t ^f . To this end 
we start with any MPS representation 

with Dj x Dj + i matrices Bj 1j ^. Starting from the identity 

x ii,t2,...,i p = 2 (^ x ii,ia,—,ip + x i 1 ,i 2 ,.:,i~p) 

we may proceed in a similar way as in (|38p for the reverse symmetry to obtain 

_ lt ((bM \(B^ o \ \\ 

Xi^ 2 ,...,i v - 3 tr (Ti) (l2) • • • (Tp) . 



B^7 V B%" I V B 



p 
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This equation motivates the definition 



B[ ij) 







In the OBC case the first and last matrices have to specialize to vectors: 



A^ = ( B ?*> B?>) and = ( ^ 



Using the involutions 



Uj:= I j° X ° J ) fori = l,...,p (48) 



gives the desired relations (|46p . In the OBC case we have to define Ui = 1. □ 

Remark 5 : If we want to represent a skew-symmetric vector x = —Jx, we may 
also use the relations (|4"T|) at all sites up to one, say site 1, where we would have to 

add a negative sign: A]* = — Ui A^L^. However, in the special TI case, where 
all matrix pairs have to be identical, this is not possible: the relations (|4T|) would 
read 

(Aj 0) Af } ) = (A UAV) (49) 

at every site j with site-independent involutions U and V. Therefore, in the pe- 
riodic ti MPS ansatz (|49p applied to symmetric-persymmetric Hamiltonians, only 
symmetric eigenvectors can occur. 

Normal Form for the Bit-Flip Symmetry 

As every involution, Uj may only have eigenvalues £ {—1, 1} and thus 

Uj = Sj^Dj^Sj , (50) 

where Dj ; ±i is a diagonal matrix with entries ±1: the Jordan canonical form implies 
Uj = Sr 1 Ju j Sj. Moreover, the Jordan blocks in Jjj. have to be involutions as well, 
so Jy. = I and therefore Juj = Dj has to be diagonal with entries ±1. 
Consider 

A<« m UjAf >U i+1 W (s-D i!±lSj ) Xf » (BiilWiBf*. 
which results in 

.(ij)c-i _ r». , . ( «. a( t j)«-i 



s J A j ' s J+i = D J;±i ( s J A j s j~+i ) D J+i;±i ( 51 ) 



showing that the MPS matrices can be chosen such that the involutions in Eqn. (|47p 
can be expressed by diagonal matrices Dji! yielding 



Af j) = D j;±1 Af D j+1;±1 . 
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Often the distribution of ±1 in Dj may be unknown. So the exchange matrix 
J = S _1 DjS is an involution where as diagonal entries in Dj, +1 and —1 appear 
> [size(J)/2j . If we double the allowed size D for the MPS matrices we can expect 
that J has at least as many +1 and —1 eigenvalues as all the appearing diagonal 
matrices Dj ; ±i- Therefore, we may heuristically replace each Dj._|-i by Jj with 
larger matrix size D leading to an ansatz requiring no a-priori information. 

Bit-Flip Symmetry in TI Representations 

If the MPS matrices fulfill the bit-flip symmetry relations (]47p and are additionally 
site-independent, one has 

A (Tj) = UA (ij) U 

with site-independent involutions U S^D-tiS. The transformation f)51 1) then 
reads 

SA^S_^= D±i (SA^S -1 ) D ± i . 

=A (i j' 

=A l 'J J 



Thus, the vector can be represented by a ti MPS fulfilling A^ 1 ^ = D-ti A^D-ti 
with the same involution T)±i everywhere. Similar results can be found in [ig| . 

The 2D x 2D involution (|48p from the proof has as eigenvalues as many +1 as 
— 1 and thus the related diagonal matrix T)±i can be written as diag(lD, — Id)- 
Therefore, instead of D-ti we may also use the 2D x 2D exchange matrix J as 
ansatz for an involution. 

Uniqueness Results for the Bit-Flip Symmetry 

The technical remarks Lemmata 13.21 13.31 and 13.41 may be put to good use in the 
following theorem. It depicts certain necessary relations for the MPS matrices to 
represent symmetric vectors. 

Theorem 3.9: Let p > 1. Assume that the MPS matrices (overM.) are related by 

= UpA^ 0) Vi and a] 1} = Uj_iAj 0) Vj forj = 2,...,p 

with square matrices Vj and Uj of appropriate size (j = 1, . . . ,p). If any choice of 
matrices A^ results in the symmetry of the represented vector x, 



Jx = x 



then it holds Uj and Vj are - up to a scalar factor - involutions for all j: Uj = Ujl, 
V? = Vjl. Furthermore, Uj = Cj ■ Vj, j = 1, ...,p with constants Cj. 

Proof : First, note that all Uj and Vj have to be nonsingular. Otherwise, we 
could use a vector a ^ 0, e.g. with Uk-ia = 0, such that = a6 H and 

Aj^ = Uk-iA^Vk = 0, giving 21,1,. = 0, but with appropriate choice of the 
other Aj°^ we can easily achieve xo,o,...,o 7^ 0. 
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Now, for all possible choices of A^\ j = 1, ...,p, it holds 

x 1A ,... A = tr (A?' • • • AgA = tr (UpA^Vx • • • U p _i A p 0) V p ) and 

V 7 V ' (52) 

= so,o,...,0 = tr LA.^ • • • A p 0) ) . 

With the notation Wj = VjUj, j = l,...,p, we have 

tr ((A? ■ ■ ■ A^O Ag») = tr ((W p a[V • • • A^W^) A?)) 

for all Ap . Therefore, Lemma 13.21 leads to 

Ai° } • • • A&AJM = WpAf Wl • • • W^^'Wp, 

and thus 

^ ((Af) • • • <] 2 )Af)) = tr ( Wp A< > Wl • • • W^W^) 

= tr ((Wp_iW p A[ 0) Wi • • • W p _ 2 ) Aj, ^) . 

If we proceed in the same way we iteratively reach 

Af Af ..-Af = W j+1 ...W p Afw 1 A(° ) ---W j _ 1 Af Wj and (53) 
tr (Af'Af • • • Af ) = tr (WjW j+a • • • WpA^Wi ■ ■ ■ Wj^Af) , (54) 

for j = p — 1, 1. Thus, we finally obtain the identities 

A£ 0) = W 2 W 3 • • • WpAi 0) Wi and (55) 
tr (A^) = tr (WiW 2 ■ ■ ■ W p a[ 0) ) , (56) 

which hold for all A^ . Lemma 13.21 applied to (|56|) states 

I = WiW 2 - W p or W^ 1 = W 2 W p . 

Inserting this in ([53]) gives A^ = Wj'Aj^Wi for all Aj° , so due to Lemma 1331 
Wi = w%I for some constant w\ ^ 0. If we make use of this relation, Eqn.1531 (case 
j = 2) leads to 

Ai 0) A 2 0) = KW 3 • • • W p ) (Ai 0) A( 0) ) W 2 for all A^, A 2 0) . 
Thus, Lemma 1331 states W 2 = u^I. By induction, Eqn. [53l reads 

Af'Af • • • Af = (w lW2 ■ ■ ■ , H W j+1 • • • W p ) (AM' • • • Af) Wj 
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for all Aj ^ , • • • Aj ^ , leading to 

Wj = Wjl or Uj = uijVT 1 for all j = 1, . . . ,p . (57) 
Considering instead xi ; o t ... t o = x o,i,...,i gives 

tr (u p a(°) Vi aW • • • A<°>) = tr (^U^V, • • • U p _ x A?>V P ) . 

Replacing A^ by Up 1 A^°' ) V^ 1 results in the above situation ([52]) . Analogously 
(Wi = x Ui, W p = VpU- 1 ) one gets Ui = c x ■ Vi and U p = c p ■ V p . 

Repeating this technique at all positions j for symmetries of the form 
Xi 1 ,...,i J ^ 1 ,i J ,i ]JrU ...,i v = x 0> . .. ,o,i,o,. ..,o = £i,...,i,o,i,...,i gives the identities 

Cj ■ Vj = Uj liJjVT 1 for all j = 1, ...,p . 
Therefore, all Uj and Vj are involutions up to a factor, 

U? = w jCj I and V? = ^1 . 

Cj 

Define uj := WjCj and Vj := to finalize the proof. □ 

Remark 6 : If we only allow unitary matrices Uj and Vj (e.g. Uj = Vj = J as 
motivated above), the factors Cj and Wj (and thus also Uj and Vj) have absolute 
value 1. 

3.2.5. Full-Bit Symmetry 

Now combine the previous symmetries and assume the following properties of 
the MPS matrices 

A| 0) = A = A H for all j and 

A^ 1} = JAJ for all j . (58) 

This ansatz results in reverse, bit-flip and bit-shift symmetry. 

Neglecting the persymmetry (I58p for the moment and only assuming 

A (0) =A (0) = ( A (0))H ^ A W =A (1) = ( A (1))H ] 

one may diagonalize (A(°)) H = A^ ) = U H AU and set B = UA^'lJ 11 . Hence, we 
propose to define a normal form of the type 

Af = A(°) = A and A< 1] = A^ 1 ) = B = B H . 

3.2.6. Reduction in the Degrees of Freedom 

The symmetries discussed in the previous paragraphs lead to a reduction of 
the number of free parameters. First let us discuss the reduction in the number 
of entries in the full vector x. The bit-shift symmetry Xi u i 3 , = £j 2 ,...,i ^ = 
... reduces the number of different entries approximately to p^ 1 2 P . Both bit-flip 
and reverse symmetry lead to a reduction factor 1/2 in each case. Note that not 
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Table 2. Listing index sets related to equal vector components for different symme- 
tries. This table shows that the bit-shift symmetry, the bit-flip symmetry and the 



reverse symmetry arc 


principally independent. 


Bit-shift symmetry 


101001000, 010010001, 100100010, 001000101, 010001010 




100010100,000101001, 001010010, 010100100 


Bit-flip symmetry 


101001000, 010110111 


Reverse symmetry 


101001000, 000100101 



all of these symmetries are independent, e.g., the symmetry x^^ = Xi 2 ^ is a 
consequence of either the bit-shift or the reverse symmetry. On the other hand the 
three symmetries are indeed independent in general. To see this we consider the 
following example with p = 9 binary digits: 

(ii,i2,i3,H,h,i6,i7,iB,i9) = (101001000) . 

Table [2] lists for all of the three classes of symmetries all index sets which are related 
to equal vector components. 

In the MPS ansatz we have similar reductions. The bit-shift symmetry uses one 
matrix pair instead of p, giving a reduction factor p. The bit-flip symmetry has 
a reduction factor 2 (if we ignore different choices for Dj ;= |-i), and in the reverse 
symmetry only half of the matrices can be chosen. Note, that this will not only 
lead to savings in memory but also to faster convergence and better approximation 
in the applied eigenvalue methods because the representation of the vectors has 
less degrees of freedom and allows a better approximation of the manifold that 
contains the eigenvector we are looking for. 

3.2.7. Further Symmetries 
In this paragraph we analyze further symmetries such as 




The following lemma states results for the symmetry (|59ap . 
Lemma 3.10: If the first matrix pair is of the type 

(A<°> , A?>) = (B , B) , (60) 

the represented vector takes the form (|59ap and, vice versa, any vector of the 
form (|59ap can be expressed by an MPS fulfilling 160\) . 

Proof: The given MPS relation (|60|) implies xo,j 2 ,i 3 ,...,i p = £i,i 2 ,i 3 ,...,i p for all 
22, • • • , i p . Hence, the represented vector x is of the form (|59ap . 

In order to specify an MPS representation for a vector x fulfilling (J59aj we consider 
any MPS representation (see, e.g., Lemma l3.ip for the vector b, 

b= £ tr(B^B^...B^)e i2 , i3 ,..., ip . 

i 2 ,...,i p 
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The definition = = Id 2 results in the desired relations 

xo,i 2 ,...,i p = xi, i2 ,..., ip = tr (b^bM . . . B p ip) ) = tr (b^ • • • B^) = b l2 _ ip 



□ 



Remark 7 : 

(1) The proof works for PBC and OBC. In the latter case B^ specializes to 
a scalar. 

(2) The second symmetry (|59bp corresponds to the relation = — Ajj°\ 
Adapting the proof to this case would give B^ = Id 2 and B^ = — Id 2 - 

(3) The symmetry type (|59cp is related to Ap 1 ^ = ±A P . The construction 

would analogously read B p ^ = Id p and Bp 1 ^ = ±Id p - 

(4) Similarly, we can impose conditions on the MPS representation that certain 
local matrix products are equal resulting in symmetry properties of a;. So 
the condition A<°>A?> = A^A™ leads to x , , i3 ,..., ip = 

Imposing the conditions A^ 0) A^ 0) = A^A^ = A^A^ = A^A^ 
leads to the symmetry x ,o,i 3 ,...,i p = xi,i,i*,-,ip = xo,l,i 3 ,...,i p = £i,o,W.-,V 

In the following theorem we state certain necessary relations for the MPS repre- 
sentation of symmetries, which are of the form (|59al , 

Theorem 3.11 : Assume that the MPS matrices (over ¥L) are related via 

A^VA^U 

with matrices V and U . If any choice of matrices Aj , j = 1, ...,p for fixed Aj 1 ^, 
j > 1 , results in a vector x of the form 



x 



then U = cl = V" 1 and so = A { ° ] . 



Proof : The assumption leads to the equation 

tr((Ai 0) -VAfu)Af ) ..-A p ip) 



for all choices of matrices Aj , j > 2. From Lemma [3.21 we obtain A<j° } = VA^U 

for all choices of Aj°\ Hence, due to Lemma f3.3| U = cl and V = I/c for a nonzero 
c. This gives U = cl = V" 1 . □ 

Remark 8 : The result of Theorem 13,111 can be easily adapted to the case (|59bj) . 
Moreover, it can be generalized to symmetries such as (|59cp . which are of the form 

x ii,...,i r ,0,i r +2,---,ip 2'ii,...,v,l,V+2, 

3.2.8. Closing remarks on symmetries 

Let us conclude this paragraph on symmetries with some remarks on applications. 
So far, we have seen that there are different symmetries which can be represented 
by convenient relations between the MPS matrices. Furthermore we proposed con- 
venient normal forms and attested related uniqueness results. It is more difficult 
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to exploit such symmetry approaches in numerical algorithms such as eigenvector 
approximation. As standard methods like DMRG ([Hj]) usually do not preserve our 
proposed symmetries, one would have to consider other techniques such as gradient 
methods, which are already in use in QI groups (see, e.g., 



4. Conclusions 

Based on a summary of definitions and properties of structured matrices, we have 
analyzed matrix symmetries as well as symmetries induced by open or periodic 
boundary conditions (as well as their interdependence). In order to describe sym- 
metry relations in physical ID many-body quantum systems by Matrix Product 
States or Tensor Trains we have developed efficient representations. To this end, 
normal forms of MPS in a general setting as well as in special symmetry relations 
have been introduced that may be useful to cut the number of degrees of freedom 
of p two-level systems down and may lead to better theoretical representations as 
well as more efficient numerical algorithms. 
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